No exact results. Similar results found.
@simoncox@seocommunity.social2024-04-11 15:55:32
Todays fun has been recovering content from 18 sites in 8 languages for some site migrations I am helping out on.
The pagination on the pages could not be crawled, and none of these pages were in xml sitemaps either, so the vast majority of the pages are not indexed in search engines. Had to do a lot of manual scraping to get a list of URLs to scrape the content from.
Time for a beverage. 🍷